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Abstract 

We characterize the symmetric capacity to within 1.7075 bits/s/Hz for the two-user Gaussian 
interference channel with feedback. The result makes use of a deterministic model to provide insights 
into the Gaussian channel. We derive a new outer bound to show that a proposed achievable scheme can 
achieve the symmetric capacity to within 1.7075 bits for all channel parameters. From this result, we 
show that feedback provides unbounded gain, i.e., the gain becomes arbitrarily large for certain channel 
parameters. It is a surprising result because feedback has been so far known to provide only power gain 
(bounded gain) in the context of multiple access channels and broadcast channels. 

Index Terms 

Feedback Capacity, The Gaussian Interference Channel, A Deterministic Model 
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I. Introduction 

Shannon showed that feedback does not increase capacity in the discrete-memoryless point- 
to-point channel [[T]]. However, in the multiple access channel (MAC), Gaarder and Wolf ^ 
showed that feedback could increase capacity although the channel is memoryless. Inspired by 
this result, Ozarow [j3l| found the feedback capacity region for the two-user Gaussian MAC. 
However, capacity results have been open for more-than-two-user Gaussian MACs and general 
MACs. Ozarow 's result implies that feedback provides only power gain (bounded gain). The 
reason of bounded gain is that transmitters cooperation induced by feedback can at most boost 
signal power (via aligning signal directions) in the MAC. Boosting signal power provides a 
capacity increase of a constant number of bits. 

Now a question is "Will feedback help significantly in other channels where each receiver 
wants to decode only desired messages in the presence of undesired messages (interferences)?" 
To answer this question, we focus on the simple two-user Gaussian interference channel where 
each receiver wants to decode the messages only from its corresponding transmitter. In this 
channel, we show that feedback can provide unbounded gain for certain channel parameters. 
For this, we first characterize the symmetric feedback capacity for a linear deterministic model 
H well capturing key properties of the Gaussian channel. Gaining insights from this model, 
we develop a simple two-staged achievable scheme in the Gaussian channel. We then derive a 
new outer bound to show that the proposed scheme achieves the symmetric capacity to within 
1.7075 bits for all channel parameters. 

The unbounded gain of feedback can be shown from the generalized degrees-of-freedom 
(g.d.o.f.) in Fig. [H defined in [5J as 

^ ^ SNR,INR^oo logSNR 

where a (x-axis) indicates the ratio of INR to SNR in dB scale: a = . Note that in the weak 

^ ^ log SNR 

interference regime (0 < a < |) and in the very strong interference regime (a > 2), feedback 
gain becomes arbitrarily large as SNR and INR go to infinity as long as channel parameters 
keep the certain scale so that a remains same. This implies unbounded gain. This is a surprising 
result because feedback has been so far known to provide only power gain {bounded gain) in 
the context of multiple access channels and broadcast channels S, Q. 
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Fig. 1 

The generalized degrees-of-freedom of the Gaussian interference channel with feedback 



Some work has been done in the interference channel with feedback Q, [0, @, [fTO|l . In 0, 
IS]], Kramer developed a feedback strategy and derived an outer bound in the Gaussian channel; 
and later derived a dependence-balance outer bound with Gastpar [i9j]. However, the gap between 
those outer bounds and the inner bound is not tight in almost cases, except one specific set of 
power and channel parameters. For some channel parameters, Kramer's scheme is worse than 
the best known non-feedback scheme [fTT]] . Recently, Jiang-Xin-Garg [lOJ found an achievable 
region in the discrete memoryless interference channel with feedback, based on the block 
Markov encoding [12J and the Han-Kobayashi scheme [fTT]] . However, their scheme includes 
three auxiliary random variables requiring further optimization. Also they did not provide any 
upper bounds. On the other hand, we propose a simple two-staged achievable scheme which 
is explicit and has only two stages. Also we derive a tighter outer bound to do tight capacity 
characterization to within a constant of number of bits. Later we will provide more detailed 
comparison to Kramer's scheme Q in Section IIV-D[ 
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II. Model 

Fig. [21 (a) describes the Gaussian interference channel with feedback. We consider the sym- 
metric interference channel where gu = 5^22 = ga^ 912 = 921 = 9c^ and Pi = P2 = P- Without 
loss of generality, we assume that signal power and noise power are normalized to 1, i.e., Pk = 1, 
Zk ^ CJV{0, 1), V/c = 1,2. Hence, signal-to-noise ratio and interference-to-noise ratio can be 
defined to capture channel gains: 



(2) 



There are two independent and uniformly distributed sources, Wk G {1, 2, • • • , Mk} , V/c = 
1, 2. Due to feedback, the encoded signal X^i of user k at time Hs a function of its own message 
and past output sequences: 



Xki = fl {Wk, ni, ■ ■ • , n(i-i)) = fl {Wk, Yt') 

where we use shorthand notation Y^~^. The symmetric capacity is defined by 

Cyrr, = sup {R : {R, i?) G 7^} , 

where TZ is the capacity region. 



(3) 



(4) 




Zi -J CAf{0, 1) 
Z2 ~ CA/'(0, 1) 

t 




(a) The Gaussian Channel 



(b) The Deterministic Channel 



Fig. 2 

The Gaussian (and Deterministic) Interference Channels with Feedback 
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We first consider the deterministic model as shown in Fig. [21 (b). The symmetric deterministic 
channel is characterized by two values: n = nn = 7^22 and m = = n2i, where n and m 
indicate the number of signal bit levels that we can send through direct link and cross link, 
respectively. For each level, we assume a modulo-l-addition. This model is useful because in 
the non-feedback case, the deterministic interference channel approximates the Gaussian channel 
within a constant gap [13J. In the feedback-case, we expect a similar constant gap as well. In 
the Gaussian channel, n and m correspond to channel gains in dB scale., i.e., 

n = [logSNRj, m = [loglNRj, 

and the modulo-2-addition corresponds to a real addition, which causes a fundamental gap 
between two channels. Our strategy is to first come up with a deterministic scheme, gain insights 
from it, and then mimic the scheme to the Gaussian channel. 

III. A Deterministic Interference Channel 
Theorem 1: The symmetric feedback capacity of a deterministic interference channel is given 

by 

max(n, m) + (n — m)+ 
^sym = • 

A. Proof of Achievablility 

Review of a non-feedback scheme |[l3ll : In the non-feedback case, we typically separate into 
two regimes depending on the strength of interference. In the strong interference channel, the 
key fact is that all of the feasible rate tuples are decodable at both receivers, i.e., all messages 
are common. Also since the number of received bit levels is m, an achievable scheme is to send 
min(y,n). Notice that the number of transmission bits is limited by the number n of direct 
link bit levels. On the other hand, in the weak interference channel, only part of information is 
visible to the other receiver. So we spit information into two parts (the Han-Kobayashi scheme): a 
common part (decodable at both receivers); a private part (decodable only at the desired receiver). 
An achievable scheme is to send (n — m) bits for private information and to send some number 
of bits for common information which depends on ^. For the feedback case, we will adopt the 
above setting. We start with the simpler case: the strong interference regime. 



January 23, 2009 



DRAFT 



6 



decode ^1^2^3'^ 



Delay 



second stage 

b2 



first stage X] 

ai 

a2 Txl 





as 








X2 


ai 


hi 




a2 


b2 


Tx 1 


as 


bs 






I 
I 

Yi first stage second stage 

bi CLl 
b2 



decode 6^ 62 
second stage first stage X 



Delay - 



decode Ci 1^2^^^ 



Delay 



m 

ia)a = — 
n 



decode 
second stag0flrst sta ge X 

hi ~ 



Delay 




a2 


b2 




bi 


ai 


as © 


bs^ 


) ai 


b2 


a2 


1 






bs 


as 


1 








a4 








ar 


arj 








ai 


bi 


~l 






a2 


b2 


1 

first stage 


second stage 


as 


bs 


ai 


bi 




be 


b4 


^2 ©^1 


as ( 


©ai 


br 


65 



decode aia2a^ 




Yi first stage second stage 



ai 


bi 


a2 


b2 


as^bi 


63 ©«i 


CM © ^2 


ae a2 


tts © h 


ar as 


bi 


ai 


b2 


a2 


63 ©ai 


as 61 


64 © a2 


^6 0^2 


&5| © as 


h®hs 



Delay 



bi ai 

h2 © ai bs © 61 
I 



c a = — = 



{b)a 



m 
n 



I 

1 

" 2 



Fig. 3 

An achievable scheme of the deterministic interference channel with feedback 



The strong interference regime (m > n): We will explain a scheme based on a simple 
example of Fig. [3] (a). Mimicking the non-feedback case, transmitters send only common in- 
formation. The main point of a scheme is to use two stages. In the first stage, transmitter 1 
sends ai, a2, as and transmitter 2 sends 6i, 62, h- Note that each transmitter sends the whole 
m bits instead of min(y,n) (the number of bits sent in the non-feedback case). Due to this, 
each receiver needs to defer decoding to the second stage. In the second stage, using feedback, 
each transmitter decodes information of the other user, e.g., transmitter 1 decodes 61, 62, h and 
transmitter 2 decodes ai, a2, as. Each transmitter then sends information of the other user. 

Now each receiver can decode its own data by subtracting the received signal in the first 
stage from the second. Receiver 1 decodes ai, a2, as by subtracting bi from the second received 



January 23, 2009 



DRAFT 



7 



signal. Notice that the second stage was used for refining all bits sent previously, without sending 
additional information. Therefore, the symmetric rate is |. Considering the general case (n, m), 
we achieve 

771 

^sym = — • (6) 

Note that with feedback, the symmetric rate can exceed n bits, which was the limit for the 
non-feedback case. This is because the very strong interfering link helps significantly to relay 
other messages through feedback. For example, the information flow of user 1 is through indirect 
links {Xi ^ Vi ^ feedback ^ X2 ^ V2 ^ ^i) instead of direct link {Xi ^ Yi). This concept 
coincides with correlation routing in Kramer's paper [|7j]. 

The weak interference regime (m < n): We will explain a scheme based on an example 
of Fig. [3] (b). Similar to the non-feedback case, information is split into two parts. But it has 
two stages. In the first stage, transmitter 1 sends private information a2 on the lower level 
(invisible to the other receiver) and common information ai on the upper signal level (visible 
to the other receiver). Similarly transmitter 2 sends hi and 62- Similar to the non-feedback case, 
each transmitter sends (n — m) private bits. However, there is a difference in sending common 
information. Each transmitter sends m common bits whatever — is, unlike the non-feedback case 
where the number of common bits depends on ^. Then, receiver 1 gets the clean signal ai on 
the upper level and the interfered signal a2 ©61 on the lower level. In this case {a = \), receiver 

1 can decode its common information ai in the first stage. However, for the other case, e.g., 
a = I (Fig. [3] (c)), receiver 1 cannot fully decode common information in the first stage because 
a part of it is interfered by common information of the other user. Therefore, each receiver needs 
to defer decoding to the second stage. 

In the second stage, with feedback, each transmitter can decode common information of the 
other user. Transmitter 1 and 2 can decode hi and ai, respectively. Each transmitter then sends 
common information of the other user on the upper level. Sending this, receiver 1 can refine 
the corrupted symbol received in the first stage without causing any interferences to the other 
receiver. On the lower level, each transmitter sends new private information. Transmitter 1 and 

2 send and 63, respectively. 

Using the first and second received signals, receiver 1 can now decode the corrupted symbol 
a2 sent in the first stage. At the same time, it can decode new private information by stripping 
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ai. During two stages, each receiver can decode three symbols out of two levels. Therefore, the 
symmetric rate is This scheme can be easily generalized into the case of (n, m). During two 
stages, each receiver can decode all of the messages sent in the first stage and a new private 
message sent in the second stage. Therefore, the symmetric rate is 

^ n + in — m) m 

i?sym = ^ ^ ^ ~ 

Remarks on the achievable scheme: Our two- staged scheme has some similarity with an 
achievable scheme in [lOJ in that using feedback each transmitter decodes common informa- 
tion of the other user. However, our scheme is different since it is explicit and has only two 
stages, while the scheme in [lOJ employs three auxiliary random variables (requiring further 
optimization) and the block Markov encoding (requiring a long block length). 

B. Proof of Converse 
We have 

N{Ri + R2) = H{Wr) + H{W2) = H{Wi\W2) + H{W2) 

< HiY,"", V.^^IW^) + I{W2; Y,"") + Ne^ 

= //(n^l^i^, W2) + HiYi') + [HiV.'^lW^) - HiY^'^lW^)] + Ne^ 

//(n^l^i^, W2) + H{Y,'') + Nej, 

//(yi^l^i^, X^, V,"") + //(y^^) + Nej, 
if) ^ 

< J2 [H{Yu\Vu^ ^2.) + H{Y2,)] + Ne^ 

i=l 

where (a) follows from the independence of Wi and W2', (b) follows from Fano's inequality; 
(c) follows from the fact that Y-^^ is a function of Wi and W2; (d) follows from H{V^^\W2) = 
H{Yf\W2) (see Claim©; (e) follows from the fact that is a function of {W2, V^^'^) (see 
Claim [2I) and is a function of X^; (/) follows from the fact that conditioning reduces 
entropy. 
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Claim 1: H{Vl^\W2) = H{Yf\W2). 
Proof: 

N 

H{Yf\W2) = J2H{Y2i\Yt\W2) 

1=1 

N 

i=l 
N 

i=l 
N 

i=l 

where (a) follows from the fact that ¥21 is a function of {X2i,Vii) and X2i is a function of 
{W2,Y;-^)\ (b) follows from the fact that is a function of (1^2,^2"^) and is a function 
of (c) follows from the fact that 1^2"^ is a function of (^2"^, ^1"^) and X2 is a function of 
{W2,Vr^) (by Claim©. 

■ 

C/a/m 2: For all i > 1, is a function of {Wi, V^^) and X| is a function of (1^2, Vi~^). 
Proof: By symmetry, it is enough to prove only one. Since the channel is deterministic 
(noiseless), XI is a function of Wi and W2. In Fig. [2l (b), we can easily see that information 
of W2 delivered to the first link must pass through V2i. Also note that Xn depends on the past 
output sequences until i — 1 (due to feedback delay). Therefore, XI is a function of {Wi, V2~^). 

■ 

Now let the time index Q be a random variable uniformly distributed over the set {1, 2, • • • , N} 
and independent of {Wi,W2, X^ , X^" ,Y,^ ,Yf), We define X, = X,g, Vj, = VkQ.Yk = 
YkQ.yk = 1, 2. If R2) is achievable, then ^ as N ^ 00. Hence, we get 

Ri + R2< H{Y,\Vi, V2) + H{Y2). 

Since the RHS is maximized when Xi and X2 are uniform and independent, we get 

max(n, m) + (n — m)+ 

^sym < • (8) 

This establishes the converse. 
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IV. The Gaussian Interference Channel 

A. An Achievable Rate 

Theorem 2: In the strong Gaussian interference channel (INR > SNR), we can achieve 

^:r' = ^log(l + INR). (9) 

In the weak Gaussian interference channel (INR < SNR), we can achieve 



log(l + H) + |log(l + "NR)-i INR>1; 



svm ^ , SNR - 

INR+1, 



^'"^ ' log(l + ^), INR<1. 



Proof: 

The strong interference regime (INR > SNR, Fig. |4](a)): Mimicking the deterministic case, 
each transmitter sends only common information and employs two stages. In the first stage, 
each transmitter sends its own signal. In the second stage, each transmitter sends information 
of the other user after decoding it with the help of feedback. In the Gaussian noisy channel, 
we need to be careful in how to combine the received signals (during two stages) to decode 
the message. Alamouti's scheme [fT4ll gives insights into this. Notice that with feedback both 
messages are available at transmitters in the second stage. However, in spite of knowing both 
messages, transmitters cannot control the messages already sent in the first stage. Hence, they 
can partially collaborate in the second stage. However, the beauty of Alamouti's scheme is that 
messages can be designed to be orthogonal (for two time slots), although the messages in the first 
time slot are sent without any coding. This was well exploited and pointed out in ifTSl . Therefore, 
with Alamouti's scheme, transmitters are able to encode messages so that those are orthogonal. 
In the interference channel, orthogonality between different messages guarantees to completely 
remove the other message (interference). This helps improving performance significantly. 

In the first stage (block), transmitter 1 and 2 send codewords and with rates Ri and 
i?2, respectively. In the second stage, using feedback, transmitter 1 decodes by stripping its 
own codeword X^ . This can be decoded if 

i?2 < -log(l + INR) hits/ s/ Hz. (11) 

Similarly transmitter 2 decodes Xf\ hence, we have the same constraint for Ri. 
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Now we apply Alamouti's scheme. In the second stage, transmitter 1 sends X^* and transmitter 
2 sends — Xf^*. Then, receiver 1 can gather the signals received during two stages. For I < i < 



(12) 



To decode Xu, receiver 1 multiplies the row vector orthogonal to the vector corresponding to 
X2i SO we get 







9d 9c 








7(1) 










+ 


7(2)* 






_ -9c 9d _ 




X2i 



(2)* 



li 



{\g,\'^+\g^\'^)Xu+9:zi]^ -9cZl 



.(2)* 



(13) 



Then, the codeword X^ can be decoded if 



i?i < 2log(l + SNR+INR) hits/ s/ Hz. 



(14) 



Similar operations are done at receiver 2. Since ([T4h is implied by (fTTI) . we get the desired result 
©. 

The weak interference regime (INR < SNR, Fig.|4](b)): Similar to the deterministic case, a 
scheme has two stages and information is split into common and private parts. Also recall that 
in the deterministic case, only common information is sent twice during two stages. Therefore, 
a natural idea is to apply Alamouti's scheme only for common information. Private information 
is newly sent for both stages. 

In the first stage, transmitter 1 independently generates a common codeword and a private 
codeword X^'^^^ with rates Ric and respectively. For power splitting, we adapt the idea of 
the simplified Han-Kobayashi scheme [[5l] where private power is set such that private information 
is in the noise level: The scheme is to set 

1 



\p = min 



INR' 



1 



(15) 



Now we assign power and Ac to X^^^^- and Xi^^i, Vi, respectively; and superpose two signals 
to form channel input. Similarly transmitter 2 sends X^'^^^ + X^. By symmetry, we use the 
same A^ and Ac. Similar to the deterministic case, each receiver defers decoding to the second 
stage. 

In the second stage, Y^'^^^ is available at transmitter 1 by feedback. Transmitter 1 subtracts 
1^ and X^ from Y^'^^^ and then decodes a common codeword X^ of 



its own codeword Xi^'^^^ and X^ from Y^'^^^ 
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the other user. We can decode this if 

i?2c< ^log( 1 + 



AJNR 



hits/ s/ Hz. 



(16) 



2"° V' ' AplNR + 1^ 
Similarly transmitter 2 decodes X^. We have the same constraint for Ri^. 

Now we apply Alamouti's scheme only for common information X^^ and X^. Transmitter 1 



sends X2* and just adds new private information X^'*^^\ On the other hand, transmitter 2 sends 
-Xg* and X^p^'^\ Then, receiver 1 gets 



(1) 



li 

(2)* 
li 



Qd 9c 
-9*c 9*d 



X2cA 



+ 



9dX^p,i 
9d^ip,i 



+ 



To decode Xid, we consider 



9d -9c 



^(1) 

(2)* 



9cy^2p,i 
9c^2p,i 



= {\9d\' + \9c\')Xr,, + \9d\'xi^, - 9c9*dXi;> 



+ 



Z 



(1) 

li 



7(2). 



.(2)* 



+ 9*d9cXi^^, - \9c\'X^;>J + g:Z\l> - g^Z- 



2 v(2)* 



.(2)* 
li 



Xi^ can be decoded if 



1 



< - log ( 1 



Ac(SNR + INR) 



bits/ s/ Hz. 



(17) 



(18) 



(19) 



2'"°^ ■ Ap(SNR + INR) + l^ 
This constraint (fT9l) is implied by (fT6)) . 

Similarly receiver 1 can decode X^, so we have the same constraint for i?2c- Now receiver 



1 subtracts (^3^, ^3^) and then decodes X^/^'^ and X{'p'^' . This can be decoded if 

< log + t4^^ 



.TV, (2) 



AJNR + 1 



(20) 



Similar operations are done at receiver 2. Under the simple power setting (fTSl) . we get the desired 
result ([TOh . 



Remarks on the achievable scheme: The Alamouti-based phase rotating technique in our 
scheme looks similar to phase rotating techniques in [3 J and JT]]. However, it is different because 
phase rotating in our scheme is to make the desired signal orthogonal to interference, while the 
purpose of [l3]], [[7l is to align the phase of desired signal to boost power gain. Also our scheme is 
essentially different from other schemes 0, JT]] which are based on Schalkwijk-Kailath scheme. 
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B. An Outer Bound 

Theorem 3: The symmetric capacity of the Gaussian interference channel with feedback is 
upper-bounded by 



C'sym < \ sup 

^ 0<p<l 



log f 1 + Yq^^YZ-^yl^) + (l + S^f^ + "^f^ + 2pVSNR-INR^ 



(21) 



Proof: 

For side information, we consider a noisy version of Vi. 



Si = V, + Z2 = gcX, + Z2. (22) 

Using this, we get 

N{Ri + R2) = H{Wi) + H{W2) = H{Wi\W2) + H{W2) 

< I{Wi;Y^''\W2) + I{W2\ If") + Nei, 

< I{W^- y^^, S^\W2) + 1(1^2; Y^"") + NeM 

= hiY,"", 5f IW2) - S^\W,, W2) + I{W2; Yi") + Ne^ 

i /i(n^, S^\W2) - [h{Zu) + /i(^2i)] + /(W-2; 1^2^) + Nej, 

= /i(n^|5f , vr2) - ^ + /^(y^^) - KZ2i) 

+ |H^2) - h{Y2''\W2)\ + A^civ 

, H/2, X^) - J2 KZii) + HY^"^) - J2 h{Z2i) + Ne^ 

(e) -'^ 

< 5] [h{Y^i\Su. X2i) - h{Zu) + h{Y2i) - h{Z2i)] + iVe^^ 

where (a) follows from the fact that adding information increases mutual information; (6) follows 
from h{Yl^,S^\Wi,W2) = E iKZu) + h{Z2^)] (see Claim [l; (c) follows from h{S^\W2) = 
h{Yf\W2) (see Claim 131); (d) follows from the fact that is a function of (1^2, ^f"^) (see 
Claim E]); (e) follows from the fact that conditioning reduces entropy. 
Claim 3: h{Y,'' , S^\W,, W2) = E iKZu) + h{Z2^)] . 
Proof: 
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HYu, Su\W,, W2, Yt\ Si-\Xu, X2^) 

i J2 KZli, Z2i\Wi, W2, YI-\ Sl-\ Xu, X2^) 

[h{Zu) + h{Z2i)] , 

where (a) follows from the fact that Xu is a function of {Wi,Y^~^) and is a function 
of {W2,Si~^) (by Claim [5]); (b) follows from the fact that Yu = gaXu + ^c^2i + Zu and 
Sii = gcXii + Z2i\ (c) follows from the memory less property of the channel and the independence 
assumption of Zu and ^2^. ■ 
Claim 4: h{S^\W2) = h{Yf\W2). 
Proof: 

h{Yi'\W2) = J2hiY2i\Yt\W2) 

where (a) follows from the fact that Y2i is a function of {X2i, Su) and is a function of 
(1^2, ^"2"^); (b) follows from the fact that X^ is a function of {W2, Y^^) and is a function 
of (y2'"\^r^); (c) follows from the fact that Y^-^ is a function of {X'f\Sl-^) and is a 
function of (1^2, ^f^) (by Claim E]). ■ 
C/a/m 5; For alH > 1, is a function of (l^i, 5^2"^) and X^ is a function of {W2, S{~^), 
Proof: By symmetry, it is enough to prove only one. Notice that X2 is a function of 
(Wi, W2, Z'2~^). In Fig. [2l we can easily see that the information of (Vl^i, Z{~'^) delivered 
to the second link must pass through S{~^. Also S{~^ contains Zl~^. Therefore, X^ is a function 

of (1^2, ^r'). ■ 

Now go back to the main stream of the proof. If (i?i,i?2) is achievable, then cat ^ as 
N ^ 00. Hence, we get 

Ri + R2< h{Yi\Si, X2) - h{Zr) + h{Y2) - KZ2). 
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Assume that Xi and X2 have covariance p, i.e., E[XiX2] = p. Then, we get 



KY2) < log 27re (1 + SNR + INR + 2|p|VSNR. INR 
Given (X2, S'l), the variance of Yi is upper bounded by 

Var[yi|X2,5i] < Ky, - Ky,^x„s,)K^l,s,)Kk(x,,s,), 



where 



Ky, =E[\Y,\']=1 + SNR + INR + pg^g, + p^g.gl 



K 



Yi{X2,Si) 



= E [Y,[X;, SI]] = [pg, + g,, gig, + p*INR] 



K(X2,Si) = E 
By further calculation, 



I V |2 V C* 



1 P*9c 
P9c 1 + INR 



/i(yi|X2,5i) <log27re 1 + 



(I-IP^SNR 
1 + (1- |p|2)INR 



From (|23|) and (|25]) . we get the desired upper bound. 



(23) 



(24) 



(25) 



C. Symmetric Capacity to Within 1.7075 Bits 

Theorem 4: For all channel parameters SNR and INR, we can achieve all rates R up to 
Csym — 1.7075. Therefore, the feedback symmetric capacity Csym satisfies 

Csyr.- 1.7075 <Csyr.<Csyr.. (26) 

Proof: 

In the weak interference regime, we get 
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SNR 



+ log (l + SNR + INR + 2VSNRINr) - log M 



2INR 



log (1 + INR) + 1 

1 + SNR + INR 2INR 



< log 



1 + INR 2INR + SNR 



1 + SNR + INR + 2VSNRINR 2INR 
' SNR + 2INR 1 + INR ' ^ ^ 



< log 2 + log y-j + 1 ^ 3.4150 

Therefore, C,y^ - i?™/^^ < 1.7075. 

In the strong interference regime, we get 

SNR 



2(Csy. - Rf;r) < log ( 1 + 1 + INR 



+ log 



1 + SNR + INR + 2VSNRINR 



1 + INR 

< log2 + log4 = 3 

Therefore, Csym — Rlym^ < 1.5. This completes the proof. ■ 

D. Comparison to Related Work SEJ, IMl 

For the Gaussian channel, Kramer developed a feedback strategy based on Schalkwijk-Kailith 
scheme and Ozarow's scheme. However, since the scheme is not expressed as a closed form, 
we cannot see how his scheme is close to the approximate symmetric capacity we derived. To 
see this, we find the generalized degrees-of-freedom of his scheme. 

Lemma 1: The generalized degrees-of-freedom of Kramer's scheme is given by 

1 — a, < a < |; 
d{o^) ={ I < a < 1; (27) 
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Proof: Let INR = SNR^. Then, by (29) in [7] and (77*) in fS^, we get 

_ /l + SNR + SNR^ + 2p*SNR^\ 




(28) 




where p* is the solution between and 1 such that 



2SNR'^P*^ + SNRV' - 4(SNR'^ + SNR^)p= 



*2 



(2 + SNR + 2SNR")p* + 2(SNR^ + SNR^) = 0. 



Notice that for < a < |, SNR is a dominant term for high SNR and p* is between and 1; 




the first and second dominant terms are SNR ^ 2^ and SNR. Also for this range, p* is very close 



to 1. Hence, we approximately get 1 — p*^ SNR 4^ . Therefore, we get the desired result for 
this range. For a > 1, note that the first and second dominant terms are SNR^^ and SNR; and 
p* is very close to 1. So we get 1 — p*^ ?^ SNR 4 . From this, we get the desired result. ■ 



Note that in Fig. [5] his scheme has the unbounded gap with capacity for all values a except 
a = 1. To compare the scheme to our results for a = 1, we also plot the symmetric rate for 
finite channel parameters as shown in Fig. [6l Notice that Kramer's scheme is very close to the 
outer bound when INR is similar to SNR. In fact, we can see capacity theorem in [8J, i.e., the 
Kramer's scheme achieves the capacity when INR = SNR — v2SNR. However, if INR is quite 
different from SNR, it becomes far away from the outer bound. Also note that our new bound 
is much better than Gastpar- Kramer's outer bounds Q, [[9]]. 



Gaining insights from a deterministic model, we found the symmetric capacity to within 1.7075 
bits/s/Hz for the two-user Gaussian interference channel with feedback. The achievable scheme 
has two stages and employs the simplified Han-Kobayashi scheme. The second stage is to help 
refining the corrupted signal received in the first stage. To make desired signals orthogonal to 
interference, we adopted Alamouti's scheme. The constant-gap result is due to a new upper 
bound. 

From this result, we discovered a significant role of feedback that it could provide unbounded 
gain in many-to-many channels. As shown in Fig. [H we can see feedback gain in two regimes. 
In the strong interference channel (a > 2), the gain is because the very strong interference link 
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provides a better alternative path (with the help of feedback) to relay information of the other 
user. This concept coincides with correlation routing in (7]]. The concept is intuitive. On the 
other hand, in the weak interference channel, there is no better alternative path. However, it 
turns out that unbounded gain of feedback can be also obtained even in this regime. This is 
quite surprising because it is counterintuitive. 

As a side generalization of a linear deterministic model, we can find the symmetric feedback 
capacity for a class of deterministic interference channels (El Gamal-Costa's model [16]). We 
described the detailed result in Appendix [II Finally, as future work, we need to extend our results 
into the general asymmetric channel with noisy feedback. 

Appendix I 
El Gamal-Costa's Deterministic Model 

El Gamal-Costa's deterministic model [16J is a generalized version of the linear deterministic 
model. The channel is described only by the following conditions: 

H{Y^\X^) = H{V2)^ 

(29) 

H{Y2\X2) = H{y^). 

Even in this general channel, we can characterize the exact symmetric capacity. 

Theorem 5: For El Gamal-Costa's deterministic interference channel, the symmetric feedback 
capacity is given by 

Csyr. = max min {/([/; yi) + //(yi|l/2,[/), 

p{u)p{xi\u)p(x2\u) 

H{Y2\X2,U) + H{Y,\Vi,V2,U), 
^iH{Y2) + HiY^\V,,V2,U)), 
I{U;Y^) + H{Y^\V^,U)}, 

where |W| < min(|Vi||V2|, |3^2|). 

Achievability Proof: We can adapt the result in [lOJ which found an achievable rate region 
in discrete memoryless interference channels with feedback. Specializing to the symmetric case, 
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(30) 



the achievable region is given by the union of all i?sym for which 
Rsyr. < HUo^Y,) + I{U,,X,;Y,\U2^Uo) 

over all joint distributions 

p{uo, Ui,U2, Xi, X2) = p{uo)p{ui\uo)p{u2\uo)p{xi\ui, Uo)p{x2\u2, Uq) , (31) 

where uq, ui, and U2 are the realizations of three auxiliary random variables Uq, Ui, and U2 
defined on arbitrary finite sets Uq, Ui, and U2. 

The idea of the scheme is to combine the block Markov encoding |fT2ll . ifTTll and the Han- 
Kobayashi scheme [fTlll . Specializing to the deterministic case, we set 

t/i = ^i, U2 = V2. (32) 

Since the role of is to reflect feedback, we still need this random variable. We replace 
with U for notational simplicity. 

Now let us check a joint distribution. Using functional relationship between Xi and Vi, we 
can simplify ([3T]) into the form of p{u, xi, X2). The idea is to write p{u, vi, V2, xi, X2) into two 
different ways: 

p{u, vi, V2, xi, X2) = p{u)p{xi\u)p{x2\u)S{vi - gi{xi))S{v2 - ^2(^2) 

(33) 

= p{u)p{vi\u)p{v2\u)p{xi\vi,u)p{x2\v2,u) 

where 5{-) indicates the Kronecker delta function and 

p{xi\u)S{vi- gi{xi)) 

p{xi\vi,u) := — — , (34) 

p{vi\u) 

p{x2\v2,u) := . (35) 

p{v2\u) 

Therefore, knowing only p{u, xi,X2) is enough to generate codebook. From ([32h and ([33]) . we 
can get the desired form of the joint distribution. Therefore, we establish the achievability proof. 

Converse Proof: One of the main points is how to introduce an auxiliary random variable 
U. We choose Ui = {Vl'^.V^'^). In Claim [6l we will show that given Ui, Xu and X2i are 
conditionally independent. 
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Consider the first upper bound. 

NRi = H{Wi) < I{Wi; Y^^) + Nsn 

< J2 [^(^n; Ui) + H{Yu\Ui)] - H{Yu\Yt\ Wi, Ui) + iVe^ 

< J2 [^(^1*; U,) + H{Yu, V2i\Ui) - H{V2^m] + NSN 
= [Hyif, Ui) + H{Yi,\V2i, Ui)] + Ne^, 

where (a) follows from Fano's inequality; (b) follows from the fact that conditioning reduces 
entropy and H{Yf\Wi) = ^ H{Yii\Yi-\ Wi, Ui) (see Claim |7l); and (c) follows from the fact 
that J2H{V2i\Ui) = J2HiYii\Yt\Wi,Ui) (see Claim IT]) and adding information increases 
mutual information. 

Now consider the second upper bound. 

NRi = H{Wi) = H{Wi\W2) < I{Wi]Y^^\W2) + NeN 
<Y,H{Yu\Yr\W2) + NeN 

H{Yu\Yr\ U,) + Nej, 
< H{Yu^ Y2^\Yr\ W^^ U,) + Ne^ 

- E H{Y2,\Yr\ U,) + H{Yu\Yr\ H^2, X^,, Y^^, Vu) + Ne^ 
(d) __ 

where (a) follows from the fact that X\, V^, X{-^, V^'^ are functions of (1^2, 
(y/"^, V2~^), Xl~^, respectively (see Claim [8]); (b) follows from the fact that adding information 
increases entropy; (c) follows from the chain rule and Vu is a function of (l2i,-^2i); (d) is 
because conditioning reduces entropy. 
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Consider the third one. 

N{Ri + R2) = H{Wi) + H{W2) = H{Wi\W2) + H{W2) 

< I{Wi; Fi^lVTa) + I{W2; Yf) + Ncn 
= H{Yf\W2) + /(W^2; Y^"") + NeN 

< HiYl", Vi^|W2) + I{W2-, Yf) + Ne^ 

= //(n^l^i^, W2) + H{Yf) + [H{V,''\W2) - H{Yi'\W2)] + Nej, 
//(n^l^i^, W2) + H{Yf) + iVe^^ 

< J] [//(Fi.l Vi„ ^2^, U,) + /(C/^; y2i) + H{Y2.m] + Ne^ 

where (a) follows from H{Vf\W2) = H{Yf\W2) (by Claim [B; (b) follows from the fact that 
is a function of (Vr2, Fi^"^) (by Claim El) and is a function of ^3^; (c) follows from 
the fact that conditioning reduces entropy. 
Now consider the last part. 

n(i?i + R2) = H{Wi) + H{W2) < I{Wi; Y,"") + I{W2; ^2"^) + Ne^ 

< [HUi;Y,i) + H{Yu\Ui) - H{Yu\Yt\Wi,Ui)] 

+ J2 [^(Ut; Y2i) + H{Y2m - H{Y2i\Yt\W2, U,)] + Ne^ 

< J2 [^(f^- + ^(^1^' ^1*1^0 - H{V2im] + I] [^(t^.; >'2i) + H{Y2i, V2i\Ui) - HiVum] + Ne^ 
= J2 ViU^-, + H{Yu\Vu, Ui)] + [HUi-, Y2i) + H{Y2.\V2i, Ut)] + Ne^ 

where (a) follows from the fact that conditioning reduces entropy and H{Y^\W2) = ^ H{Y2i\Y2~^, W2,Ui) 
by ClaimH (b) follows from the fact that ^ H{V2i\Ui) = E H{Yii\Yi-\ Wi, Ui), E H{Vii\Ui) = 
^H(Y2i\Y2~^, W2, Ui) (by Claim IT)), and adding information increases entropy. 

Let Q be the time index uniformly distributed over the set {1, 2, • • • , N} and independent of 
{W,,W2,X^,Xi',Yf,Y,''). Define X, = X,q, Vi = Viq, X2 = X2Q, V2 = V,q, Fi = Fiq, 
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^2 = Y2Q, U = (C/g, Q). If R2) is achievable, then cat ^ as ^ oc. Hence, we obtain 

Ri<I{Y,;U) + H{Y,\V2,U)i 

Ri < H{Y2\X2, U) + H{Y^\V^, U), 
Ri + R2< I{U; Y2) + H{Y,\V,, U) + H{Y2\U), 
Ri + R2< I{U; Y,) + /([/; Fs) + + HiY^lV^). 

By Claim [6l Xi and X2 are conditionally independent given U. Therefore, 3p{u, xi,X2) = 
p(t^)p(xi|2i)p(x2|t^) such that the desired inequalities hold. This establishes the converse. 
Several Claims for the Converse Proof: 

Claim 6: Given Ui = {Vi~^, ^2~^)^ ^2% are conditionally independent. Consequently, 

H{Wr\W2,U) = H{Wr\U), (36) 

H[X^\X2,U) = H{X^\U), (37) 

H{V^\V2^U) = H{V^\U). (38) 
Proof: The idea is based on the technique used in ifTSll . For completeness we describe 
it thoroughly. For two arbitrary message pairs {wi,W2) and {w^.w^), we obtain the following 
relationship: 

p{ui\wi, W2)p{ui\w[, w'2) = ^r^ki^ ^2)^>K"^ ^r^iK^ ^2) 

i-l 

- Ylpi'^ijK'^^ ^2)p(^2j>r\ ^2) • p(^ij>r\ ^)i>(^2j>r\ ^2) 

= n^'^^i-^'i^2"\^i)p(^2j>r\^2) •p(^ij>r\^)p(^2j>r\^2) 
3=1 

i-l 

= ]^P{vij\vr\^[)p{v2j\vi~\w2) 'P{vij\vf\wi)p{v2j\vi~\w'^) 
= p{Ui\w[, W2)p{Ui\wi, W^), 

(39) 

where (a) follows from the chain rule; (b) follows from Claim [2l (c) follows from rearranging 
a product order. 
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Using this, we obtain 

p{wi)p{w2)p{Ui\wi,W2) 

p{Wi,W2\Ui) = — 

PyUi) 

_ piwi)p{w2)piUi\wi,W2) 12w', PK)pK)p(-»^m, W^) 

PiUi) p{Ui) 
(a) E E )p(^^2)p(^;i)p(tt;2)p(ttt I W[ , W2)p(-»i I Wl , ^2) 

p{Ui)p{Ui) 

_ 12yj'^Piwl)piw2)p{Ui\Wi,w'2) ^^,^p{w2)p{w[)p{Ui\w[,W2) 
P{Ui) p{Ui) 

= p{Wi\Ui) ■p{w2\Ui), 

where (a) follows from ((39l) . This proves the independence of VFi and W2 given Wj. 
Also it follows easily that 

p{x2M, xu) p{r{W2, vi-')\vi-\ vi-\ fiW,, vi-')) 

(40) 

^^p{f{W2A-')K-\v{-')=p{x2i\Ui), 

where (a) follows from Claim [2l and (6) follows from the independence of Wi and VI/2 given 
Ui, This implies that and X2i are independent given ui. Since ^1^, are functions of xu, X2i, 
respectively, vu and V2i are also independent given ui. Therefore, we complete the proof. ■ 
Claim 7: H{Yi'\W2) = H{Y2^\Yr\W2^U,) H{Vu\U,). 
Proof: 

We prove the first equality. 

H{Y2''\W2) = Y,H{Y2i\Yt\W2) ^^Y.H^^^i\^t\W2,XlVlVt') 
= H{Y2i\Yt\ W2, XI Ui) i H{Y2i\Yr\ W2, Ui), 
where (a) follows from the fact that V^, Vt^ are functions of {W2, Y^^), Y^^), 
respectively; (6) follows from the fact that is a function of (^2,^2"^)- 
Next we prove the second one. 

Y,Hiy^i\Ui) J]//(VH|t/„H/2) J]i/(VidVrMy2) = H{y,''\W2) H{Y2''\W2), 

where (a) is because Vu and VI/2 are conditionally independent given Ui (by Claim [6l); and (6) 
follows from the fact that ^2"^ is a function of (VI/2, ^1"^)^ and (c) follows from Claim [H ■ 
Claim 8: For i > 1, is a function of {Wi, Y^^) and is a function of (W2, y/"^). 
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Proof: By symmetry, it is enough to prove only one. We know from Claim [2l that X\ is a 
function of (Vl^i, V^~^). Note that V^~^ is a function of X^"^ (a function of {Y^~^ , Vi~^)). Also 
note that Vl~^ is a function of X{~^ (a function of (Vl/^i, V^s'"^) by Claim O. Hence we know 
that 

X{ is a function of (t^i, y2'"^ ^T^)- 

Iterating this procedure {i — 3) times, we know that X\ is a function of (T^i, I/21, y^^)- Note 
that 1/21 is a function of X21 (a function of (l^ii,l2i)) and is a function of Xn. Since Xn 
depends only on Wi due to no feedback in the initial time, we conclude that 

X{ is a function of {Wi,Y^-^). 
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Fig. 4 

An achievable scheme of the Gaussian interference channel with feedback. 
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Fig. 5 

The generalized degrees-of-freedom of the optimum and Kramer's scheme 
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Fig. 6 

The symmetric rate of the proposed scheme and Kramer's scheme 
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